Device and method for processing user input

ABSTRACT

A method for generating display data comprises detecting user input via an input interface. A processor is in communication with the input interface to generate display data comprising a display object for display by a display device. The display object is representative of an action that will subsequently be performed by the processor on continuation of the user input. The display data on the display device is output whilst the user input is being detected. Alternatively, the display object is caused to appear on the display device over time as the user input is being performed, wherein the rate at which the display object appears is different to the rate of performance of the user input. A device and executable computer program for performing the steps of the method is also provided.

TECHNICAL FIELD

The embodiments disclosed herein relate to a device, system and methodfor generating display data.

BACKGROUND

Electronic devices may increasingly be controlled using a wide varietyof input types. For example, gesture-based user interfaces enable a userto control the device using gestures such as swipes across a touchscreeninterface. However, a common problem found with such user interfaces ishow to inform a user of the inputs required to interact with and controlthe device. Users unaware of the required inputs will not be able tointeract effectively with the device and may accidentally activate inputcommands resulting in undesired actions being performed by the device.

Furthermore, precise input commands such as selection of discreet iconsor buttons requires a level of precision that is beyond the capabilitiesof users who are unfamiliar with such user interfaces, unable to view orconcentrate on the screen, or unable to execute the required motionswith the necessary precision.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure and the embodiments set out herein can be betterunderstood with reference to the description of the embodiments set outbelow, in conjunction with the appended drawings which are:

FIG. 1 is a schematic diagram illustrating components of an exemplaryelectronic device usable by a user in some embodiments;

FIG. 2 is a plan view of the upper external side of one exemplaryelectronic device usable by an end-user in some embodiments;

FIG. 3 is a plan view of the upper external side of one alternativeexemplary electronic device usable by an end-user in some embodiments;

FIG. 4 is a schematic diagram of an exemplary system in which theaforementioned electronic devices can be employed in some exemplaryembodiments;

FIG. 5 is a flow diagram showing a method for generating display data;

FIGS. 6A(i)-(iv) and 6B(i)-(iv) are exemplary displays showing exemplaryinput sequences;

FIG. 7 is a flow diagram showing a method for generating display data;and

FIG. 8 is a flow diagram showing a method for modifying the output ofmedia content.

DETAILED DESCRIPTION

In a first aspect, there is provided a method for generating displaydata. The method comprises detecting user input via an input interface,the user input comprising a first input; and operating a processor incommunication with the input interface to generate display datacomprising a display object for display by a display device, wherein thedisplay object is representative of an action that will subsequently beperformed by the processor on completion of the first input; andoperating the processor to output the display data on the display devicewhilst a common initial input of the first input is being detected. Auser providing input for operating the processor is therefore able todetermine what action completion of the user input will cause theprocessor to perform. A user input is therefore completed if, ondetecting the input, the processor determines that an action should beperformed.

In one example, the first input comprises a first additional input whichis detectable by the processor after the common initial input. Asdiscussed below in more detail, the common initial input may comprise aswipe gesture across a touchscreen interface performed using a finger orstylus and the first additional input may comprise removing the fingeror stylus from the touchscreen interface. In general, the firstadditional input may simply be the step that completes the first inputat the end of the common initial input.

The display object may be representative of the first additional inputwhich must be detected by the processor for it to determine that theuser input comprises the first input.

The user input may comprise a second input, in response to which theprocessor does not perform the action, the second input also comprisingthe common initial input.

In addition to the common initial input, the second input may alsocomprise a second additional input which is detectable by the processorafter the common initial input, wherein the first additional input andthe second additional input are different.

The processor may further operate to determine whether completion of thefirst input has occurred; and perform the action only if completion ofthe first input is detected. For example, if the processor detects thecommon initial input and the first additional input, the processordetermines that the first input has been completed and the action willbe performed by the processor. On the other hand, if the processordetects that the common initial input and the second additional input,the processor determines the second user input and that the first userinput has not been completed, in which case, the processor does notperform the action.

The processor may generate the display data in such a way that thedisplay object is caused to appear on the display device as the commoninitial input is being performed, wherein the rate at which the displayobject appears is different to the rate of detection of the commoninitial input. The rate at which the display object appears may begreater (i.e. faster) that the rate of performance of the common initialinput. This permits a user to acquire additional information concerningtheir action when providing user input which might not otherwise beavailable if the information were to appear on the display at the samerate as the user input is performed.

The display object may be representative of an extent of completion ofthe common initial input. The display object may additionally berepresentative of an extent of completion of the first input.

The action may correspond to selection of media content, such as audioor video content, in which case the processor outputs the media content.In this case, the display object may be representative of the mediacontent.

The user interface may be a touchscreen interface, the user inputcomprise a swipe gesture across the touchscreen interface, and theaction comprise modifying a current output of media content, forexample, by pausing output of the media content.

In a second aspect, there is provided a method for generating displaydata, the method comprising detecting user input via an input interface,the user input comprising a first input; and operating a processor incommunication with the input interface to: generate display datacomprising a display object for display by a display device, wherein thedisplay object is representative of content that will subsequently beoutput on completion of the first user input; and output the displaydata on the display device whilst a common initial input of the firstinput is being detected in such a way that the display object is causedto appear on the display device as the user input is being detected,wherein the rate at which the display object appears is different to therate of detection of the common initial input. For example, the displayobject may appear at a faster rate than the rate at which the processordetects the user input via the input interface. This permits a user toacquire additional information concerning their action when providinguser input which might not otherwise be available if the informationwere to appear on the display at the same rate as the user input isperformed.

In a third aspect, there is provided a method for modifying an output ofmedia content, the method comprising operating a processor to cause anoutput of media content; detecting user input via a touchscreeninterface, the user input comprising a swipe gesture across thetouchscreen interface; and operating the processor, responsive to theuser input, to cause a first modification of the output of the mediacontent.

The user input may comprise a vertical swipe gesture across thetouchscreen interface in a first direction.

The processor may detect second user input via the input interface. Thesecond user input may comprise a vertical swipe gesture across thetouchscreen interface in a second direction opposite to the firstdirection; and the processor may perform the reverse of the firstmodification in response to the second user input detected.

The first modification may comprise pausing output of the media content.

In a fourth aspect, there is provided a computer-readable mediumcomprising executable instructions which, when executed, cause theprocessor to perform the above methods.

In a fifth aspect, there is provided a device for generating displaydata, the device comprising: an input interface configured to detectuser input, the user input comprising a first input; a processor incommunication with the input interface, the processor being configuredto: generate display data comprising a display object for display by adisplay device, wherein the display object is representative of anaction that will subsequently be performed by the processor oncompletion of the first input; and output the display data on thedisplay device whilst a common initial input of the first input is beingdetected. The device may be an electronic device as described furtherbelow.

In one example, the processor is configured to detect if the first inputcomprises a first additional input which is detectable by the processorafter the common initial input.

The processor may be additionally configured to generate the displaydata such that the display object is representative of the firstadditional input which must be detected by the processor for it todetermine that the user input comprises the first input.

The processor may be additionally configured to determine if the userinput comprises a second input, in response to which the processor doesnot perform the action, the second input also comprising the commoninitial input.

The processor may be additionally configured to detect if the secondinput comprises a second additional input after the common initialinput, wherein the first additional input and the second additionalinput are different.

The processor may be additionally configured to determine whethercompletion of the first input has occurred and perform the action onlyif completion of the first input has occurred.

The processor may be additionally configured to generate the displaydata in such a way that the display object is caused to appear on thedisplay device as the common initial input is being detected, whereinthe rate at which the display object appears is faster than the rate ofdetection of the common initial input. The display object mayrepresentative of one or more of an extent of completion of the commoninitial input; an extent of completion of the first input or furtheruser input required for the processor to determine that the user inputcomprises the first input.

The processor may be configured to perform an action corresponding toselection of media content and additionally to output the media content.In this case, the display object may be representative of the mediacontent.

The user interface of the device may be a touchscreen interface, theuser input comprise a swipe gesture across the touchscreen interface,and the processor may be configured to perform an action comprisingmodifying a current output of media content, for example, by pausingoutput of the media content.

In a sixth aspect, there is provided a device for generating displaydata, the device comprising: an input interface for detecting userinput, the user input comprising a first input; and a processor incommunication with the input interface, the processor being configuredto: generate display data comprising a display object for display by adisplay device, wherein the display object is representative of contentthat will subsequently be output on completion of the user input; andoutput the display data on the display device whilst a common initialinput of the first input is being detected in such a way that thedisplay object is caused to appear on the display device as the userinput is being performed wherein the rate at which the display objectappears is different to the rate of detection of the user input. Thedevice may be an electronic device as described further below.

In a seventh aspect, there is provided a device comprising a touchscreeninterface configured to detect user input, the user input comprising aswipe gesture across the touchscreen interface; and a processorconfigured to cause an output of media content; and to cause a firstmodification of the output of the media content responsive to the userinput. The device may be an electronic device as described furtherbelow.

The processor may be configured to detect user input comprising avertical swipe gesture across the touchscreen interface in a firstdirection.

The processor may be further configured to detect second user input viathe input interface, the second user input comprising a vertical swipegesture across the touchscreen interface in a second direction oppositeto the first direction; and the processor may perform the reverse of thefirst modification in response to the second user input detected. In oneexample, the first modification comprises pausing output of the mediacontent.

This disclosure below is a description of one or more exemplaryembodiments which are not intended to be limiting on the scope of theappended claims.

Reference is made to FIG. 1 which illustrates an exemplary electronicdevice 201 which is usable in accordance with the disclosure below. Anelectronic device 201 such as the electronic device 201 of FIG. 1 isconfigured to generate a user-controllable interface on a built-indisplay or on a remote, external display device, or on a built-indisplay and on a remote, external display device. In the context of thisdisclosure, the term “remote” means a display screen which is notbuilt-in to the electronic device 201 with which the electronic device201 communicates via a physical wired connection or via a wirelessconnection.

It will be appreciated that, in other embodiments, some of the features,systems or subsystems of the electronic device 201 discussed below withreference to FIG. 1 may be omitted from electronic devices 201 which areintended to perform solely operations in relation to the generation andoutput of display data and the modification of media content output.

In the illustrated exemplary embodiment, the electronic device 201 is acommunication device and, more particularly, is a mobile communicationdevice having data and voice communication capabilities, and thecapability to communicate with other computer systems; for example, viathe Internet. It will be appreciated that the electronic device 201 maytake other forms, including any one of the forms listed below. Dependingon the functionality provided by the electronic device 201, in certainexemplary embodiments, the electronic device 201 is a multiple-modecommunication device configured for both data and voice communication, amobile telephone, such as a smartphone, a wearable computer such as awatch, a tablet computer, a personal digital assistant (PDA), or acomputer system such as a notebook, laptop or desktop system. Theelectronic device 201 may take other forms apart from those specificallylisted above. The electronic device 201 may also be referred to as amobile communications device, a communication device, a mobile deviceand, in some cases, as a device. In the context of this disclosure, theterm “mobile” means the device is of a size or weight which makes itreadily portable by a single individual, e.g. of a weight less than 5,4, 3, 2, 1, 0.5, 0.4, 0.3, 0.2 or 0.1 kilograms, or of a volume lessthan 15,000, 10,000, 5,000, 4,000, 3,000, 2,000, 1,000, 500, 400, 300,200, 100, 90, 80, 70, 60, 50, 40, 30, 20, 10 or 5 cubic centimeters. Assuch, the device 201 may be portable in a bag, or clothing pocket.

The electronic device 201 includes a controller including a processor240 (such as a microprocessor) which controls the operation of theelectronic device 201. In certain electronic devices, more than oneprocessor is provided, with each processor in communication with eachother and configured to perform operations in parallel, so that theytogether control the overall operation of the electronic device. Theprocessor 240 interacts with device subsystems, such as a wirelesscommunication subsystem 211 for exchanging radio frequency signals witha wireless network 101 to perform communication functions. The processor240 is communicably coupled with additional device subsystems includingone or more output interfaces 205 (such as one or more of: a display204, a speaker 256, electromagnetic (EM) radiation source 257), one ormore input interfaces 206 (such as one or more of: a camera 253,microphone 258, keyboard (not shown), control buttons (not shown), anavigational input device (not shown), a touch-sensitive overlay (notshown)) associated with a touchscreen 204, an orientation subsystem 249,memory (such as flash memory 244, random access memory (RAM) 246, readonly memory (ROM) 248, etc.), auxiliary input/output (I/O) subsystems250, a data port 252 (which may be a serial data port, such as aUniversal Serial Bus (USB) data port), an external video output port254, a near field communications (NFC) subsystem 265, a short-rangecommunication subsystem 262, a clock subsystem 266, a battery interface236, and other device subsystems generally designated as 264. Some ofthe subsystems shown in FIG. 1 perform communication-related functions,whereas other subsystems may provide “resident” or on-device functions.

The electronic device 201 stores data 227 in an erasable persistentmemory, which in one exemplary embodiment is the flash memory 244. Invarious exemplary embodiments, the data 227 includes service dataincluding information used by the electronic device 201 to establish andmaintain communication with the wireless network 101. The data 227 mayalso include user application data such as email messages, address bookand contact information, calendar and schedule information, notepaddocuments, presentation documents and information, word processordocuments and information, spread sheet documents and information;desktop publishing documents and information, database files andinformation; image files, video files, audio files, internet web pages,and other commonly stored user information stored on the electronicdevice 201 by its user, and other data. The data may also includeprogram application data such as functions, controls and interfaces froman application such as an email application, an address bookapplication, a calendar application, a notepad application, apresentation application, a word processor application, a spread sheetapplication, a desktop publishing application, a database application, amedia application such as a picture viewer, a video player or an audioplayer, and a web browser. The data 227 stored in the persistent memory(e.g. flash memory 244) of the electronic device 201 may be organized,at least partially, into one or more databases or data stores. Thedatabases or data stores may contain data items of the same data type orassociated with the same application. For example, email messages,contact records, and task items may be stored in individual databaseswithin the device memory.

The electronic device 201 includes a clock subsystem or module 266comprising a system clock configured to measure system time. In oneexample, the system clock comprises its own alternate power source. Thesystem clock provides an indicator of a current time value, the systemtime, represented as a year/month/day/hour/minute/second/millisecondsvalue. In other examples, the clock subsystem 266 additionally oralternatively provides an indicator of the current time valuerepresented as a count of the number of ticks of known duration since aparticular epoch.

The clock subsystem 266, the communication subsystem 211, the NFCsubsystem, 265, the short-range wireless communications subsystem 262,and the battery interface 236 together form a status report subsystem268 which is configured to provide an indicator of the operating statusof the device.

The display 204 receives display data generated by the processor 240,such that the display 204 displays certain application data stored as asegment of the data 227 from the memory (any of the flash memory 244,random access memory (RAM) 246, read only memory (ROM) 248) in apredetermined way on display screen (not shown) of the display 204,according to the processing performed by the processor 240.

In certain exemplary embodiments, the external video output port 254 isintegrated with the data port 252. The external video output port 254 isconfigured to connect the electronic device 201 via a wired connection(e.g. video graphics array (VGA), digital visual interface (DVI) or highdefinition multimedia interface (HDMI)) to an external (or remote)display device 290 which is separate and remote from the electronicdevice 201 and its display 204. The processor 240 outputs externaldisplay data generated by the processor 240 via the external videooutput port 254, such that the external display device 290 can displayapplication data from the memory module in a predetermined way on anexternal display screen (not shown) of the external display device 290.The processor 240 may also communicate the external display data to theexternal display device 290 in a similar fashion over a wirelesscommunications path.

At any given time, the display data and the external display datagenerated by the processor 240 may be identical or similar for apredetermined period of time, but may also differ for a predeterminedperiod of time, with the processor 240 controlling whether the displaydata and the external display data are identical or differ based oninput from one or more of the input interfaces 206. In this context, theword “identical” means that both sets of data comprise similar contentso as to generate an identical or substantially similar display atsubstantially the same time on both the external display device 290 andthe display 204. In this context, the word “differ” means that theexternal display data and display data are not identical; this is to saythat these data may (but not necessarily) include identical elements ofdata, for example representative of the same application data, but theexternal display data and display data are not wholly identical. Hence,the display on both the external display device 290 and the display 204are not wholly identical, although similar or identical individual itemsof content based on the application data may be displayed on both theexternal display device 290 and the display 204.

In at least some exemplary embodiments, the electronic device 201includes a touchscreen which acts as both an input interface 206 (e.g.touch-sensitive overlay) and an output interface 205 (i.e. display). Thetouchscreen may be constructed using a touch-sensitive input surfacewhich is connected to an electronic controller and which overlays thedisplay 204. The touch-sensitive overlay and the electronic controllerprovide a touch-sensitive input interface 206 and the processor 240interacts with the touch-sensitive overlay via the electroniccontroller.

As discussed in detail below with respect to FIGS. 5-8, the processor240 is in communication with the memory and the touch-sensitive inputinterface 206 to detect user input via the input interface 206. Theprocessor 240 then generates or updates display data comprising adisplay object for display by the display device 204 in accordance withthe user input. The display object may be representative of an actionthat will subsequently be performed by the processor 240 on continuationof the user input. Additionally or alternatively, the display object maybe representative of content that will be output on continuation of theuser input. The processor 240 then outputs the display data for displayon the display device 204. Additionally or alternatively, the processor240 may modify a current output of media in accordance with user inputdetected via the touchscreen interface 206. In an example, the userinput comprises a swipe gesture across the touchscreen interface 206.

In at least some exemplary embodiments, the touch-sensitive overlay hasa touch-sensitive input surface which is larger than the display 204.For example, in at least some exemplary embodiments, the touch-sensitiveoverlay may extend overtop of a frame (not shown) which surrounds thedisplay 204. In such exemplary embodiments, the frame (not shown) may bereferred to as an active frame since it is capable of acting as an inputinterface 206. In at least some exemplary embodiments, thetouch-sensitive overlay may extend to the sides of the electronic device201.

As noted above, in some exemplary embodiments, the electronic device 201includes a communication subsystem 211 which allows the electronicdevice 201 to communicate over a wireless network 101. The communicationsubsystem 211 includes a receiver 212, a transmitter 213, and associatedcomponents, such as one or more antenna elements 214 and 215, localoscillators (LOs) 216, and a processing module such as a digital signalprocessor (DSP) 217 which is in communication with the processor 240.The antenna elements 214 and 215 may be embedded or internal to theelectronic device 201 and a single antenna may be shared by bothreceiver and transmitter. The particular design of the wirelesscommunication subsystem 211 depends on the wireless network 101 in whichelectronic device 201 is intended to operate.

In at least some exemplary embodiments, the electronic device 201communicates with any one of a plurality of fixed transceiver basestations of the wireless network 101 within its geographic coveragearea. The electronic device 201 may send and receive communicationsignals over the wireless network 101 after the required networkregistration or activation procedures have been completed. Signalsreceived by the antenna 214 through the wireless network 101 are inputto the receiver 212, which may perform such common receiver functions assignal amplification, frequency down conversion, filtering, channelselection, etc., as well as analog-to-digital (ND) conversion. NDconversion of a received signal allows more complex communicationfunctions such as demodulation and decoding to be performed in the DSP217. In a similar manner, signals to be transmitted are processed,including modulation and encoding, for example, by the DSP 217. TheseDSP-processed signals are input to the transmitter 213 fordigital-to-analog (D/A) conversion, frequency up conversion, filtering,amplification, and transmission to the wireless network 101 via theantenna 215. The DSP 217 not only processes communication signals, butmay also provide for receiver and transmitter control. For example, thegains applied to communication signals in the receiver 212 and thetransmitter 213 may be adaptively controlled through automatic gaincontrol algorithms implemented in the DSP 217.

In some exemplary embodiments, the auxiliary input/output (I/O)subsystems 250 include an external communication link or interface; forexample, an Ethernet connection. The electronic device 201 may includeother wireless communication interfaces for communicating with othertypes of wireless networks; for example, a wireless network such as anorthogonal frequency division multiplexed (OFDM) network. The auxiliaryI/O subsystems 250 may include a vibrator for providing vibratorynotifications in response to various events on the electronic device 201such as receipt of an electronic communication or incoming phone call,or for other purposes such as haptic feedback (touch feedback).

In some exemplary embodiments, the electronic device 201 also includes aremovable memory module 230 (typically including flash memory, such as aremovable memory card) and a memory interface 232. Network access may beassociated with a subscriber or user of the electronic device 201 viathe memory module 230, which may be a Subscriber Identity Module (SIM)card for use in a GSM network or other type of memory card for use inthe relevant wireless network type. The memory module 230 is inserted inor connected to the memory card interface 232 of the electronic device201 in order to operate in conjunction with the wireless network 101.

The data port 252 may be used for synchronization with a user's hostcomputer system (not shown). The data port 252 enables a user to setpreferences through an external device or software application andextends the capabilities of the electronic device 201 by providing forinformation or software downloads to the electronic device 201 otherthan through the wireless network 101. The alternate download path mayfor example, be used to load an encryption key onto the electronicdevice 201 through a direct, reliable and trusted connection to therebyprovide secure device communication.

In at least some exemplary embodiments, the electronic device 201 alsoincludes a device orientation subsystem 249 including at least oneorientation sensor 251 which is connected to the processor 240 and whichis controlled by one or a combination of a monitoring circuit andoperating software. The orientation sensor 251 detects the orientationof the device 201 or information from which the orientation of thedevice 201 can be determined, such as acceleration. In some exemplaryembodiments, the orientation sensor 251 is an accelerometer, such as athree-axis accelerometer. An accelerometer is a sensor which convertsacceleration from motion (e.g. movement of the device 201 or a portionthereof due to the strike force) and gravity which are detected by asensing element into an electrical signal (producing a correspondingchange in output). Accelerometers may be available in one, two or threeaxis configurations. Higher order axis configurations are also possible.Accelerometers may produce digital or analog output signals depending onthe type of accelerometer.

An orientation sensor 251 may generate orientation data which specifiesthe orientation of the electronic device 201. The orientation data, inat least some exemplary embodiments, specifies the orientation of thedevice 201 relative to the gravitational field of the earth.Additionally or alternatively, the orientation sensor 251 may generateorientation data which specifies the orientation of the device relativeto known locations or fixtures in a communication network.

In some exemplary embodiments, the orientation subsystem 249 includesother orientation sensors 251, instead of or in addition toaccelerometers. For example, in various exemplary embodiments, theorientation subsystem 249 may include a gravity sensor, a gyroscope, atilt sensor, an electronic compass or other suitable sensor, orcombinations thereof. In some exemplary embodiments, the deviceorientation subsystem 249 may include two or more orientation sensors251 such as an accelerometer and an electronic compass.

The electronic device 201, in at least some exemplary embodiments,includes a Near-Field Communication (NFC) subsystem 265. The NFCsubsystem 265 is configured to communicate with other electronic devices201 or tags, using an NFC communications protocol. NFC is a set ofshort-range wireless technologies which typically require a distance of4 cm or less for communications. The NFC subsystem 265 may include anNFC chip and an NFC antenna. In such an embodiment, the orientationsensor 251 may generate data which specifies a distance between theelectronic device 201 and an NFC transceiver.

The electronic device 201 includes a microphone or one or more speakers.In at least some exemplary embodiments, an electronic device 201includes a plurality of speakers 256. For example, in some exemplaryembodiments, the electronic device 201 includes two or more speakers256. The two or more speakers 256 may, for example, be disposed inspaced relation to one another. That is, in at least some exemplaryembodiments, the electronic device 201 may include a first speaker and asecond speaker and the first speaker and the second speaker may bespatially separated from one another within the electronic device 201.In at least some exemplary embodiments, the display 204 may be disposedbetween the first speaker and the second speaker of the electronicdevice. In such exemplary embodiments, the first speaker may be locatedat one side of the display 204 and the second speaker may be located atanother side of the display which is opposite the side of the displaywhere the first speaker is located. For example, the first speaker maybe disposed at a left side of the display and the second speaker may bedisposed at a right side of the display.

In at least some exemplary embodiments, each speaker 256 is associatedwith a separate audio channel. The multiple speakers may, for example,be used to provide stereophonic sound (which may also be referred to asstereo).

The electronic device 201 may also include one or more cameras 253. Theone or more cameras 253 may be capable of capturing images in the formof still photographs or motion video.

In at least some exemplary embodiments, the electronic device 201includes a front facing camera 253. A front facing camera is a camerawhich is generally located on a front face of the electronic device 201.The front face is typically the face on which a display 204 is mounted.That is, the display 204 is configured to display content which may beviewed from a side of the electronic device 201 where the camera 253 isdirected. The front facing camera 253 may be located anywhere on thefront surface of the electronic device; for example, the camera 253 maybe located above or below the display 204. The camera 253 may be a fixedposition camera which is not movable relative to the display 204 of theelectronic device 201 or the housing of the electronic device 201. Insuch exemplary embodiments, the direction of capture of the camera isalways predictable relative to the display 204 or the housing. In atleast some exemplary embodiments, the camera may be provided in acentral location relative to the display 204 to facilitate imageacquisition of a face.

In at least some exemplary embodiments, the electronic device 201includes an electromagnetic (EM) radiation source 257. In at least someexemplary embodiments, the EM radiation source 257 is configured to emitelectromagnetic radiation from the side of the electronic device whichis associated with a camera 253 of that electronic device 201. Forexample, where the camera is a front facing camera 253, the electronicdevice 201 may be configured to emit electromagnetic radiation from thefront face of the electronic device 201. That is, in at least someexemplary embodiments, the electromagnetic radiation source 257 isconfigured to emit radiation in a direction which may visible by thecamera. That is, the camera 253 and the electromagnetic radiation source257 may be disposed on the electronic device 201 so that electromagneticradiation emitted by the electromagnetic radiation source 257 is visiblein images detected by the camera.

In some exemplary embodiments, the electromagnetic radiation source 257is an infrared (IR) radiation source which is configured to emitinfrared radiation. In at least some exemplary embodiments, theelectromagnetic radiation source 257 may be configured to emit radiationwhich is not part of the visible spectrum. The camera 253 may be acamera which is configured to capture radiation of the type emitted bythe electromagnetic radiation source 257. Accordingly, in at least someexemplary embodiments, the camera 253 is configured to capture at leastsome electromagnetic radiation which is not in the visible spectrum.

In some exemplary embodiments, the electronic device 201 is providedwith a service routing application programming interface (API) whichprovides an application with the ability to route traffic through aserial data (i.e., USB) or Bluetooth® (Bluetooth® is a registeredtrademark of Bluetooth SIG, Inc.) connection to a host computer systemusing standard connectivity protocols. When a user connects theirelectronic device 201 to the host computer system via a USB cable orBluetooth® connection, traffic that was destined for the wirelessnetwork 101 is automatically routed to the electronic device 201 usingthe USB cable or Bluetooth® connection. Similarly, any traffic destinedfor the wireless network 101 is automatically sent over the USB cableBluetooth® connection to the host computer system for processing.

The electronic device 201 also includes a battery 238 as a power source,which is typically one or more rechargeable batteries that may becharged for example, through charging circuitry coupled to a batteryinterface 236 such as the data port 252. The battery 238 provideselectrical power to at least some of the electrical circuitry in theelectronic device 201, and the battery interface 236 provides amechanical and electrical connection for the battery 238. The batteryinterface 236 is coupled to a regulator (not shown) which provides powerV+ to the circuitry of the electronic device 201.

The electronic device 201 includes a short-range communication subsystem262 which provides for wireless communication between the electronicdevice 201 and other electronic devices 201. In at least some exemplaryembodiments, the short-range communication subsystem 262 is a wirelessbus protocol compliant communication mechanism such as a Bluetooth®communication module to provide for communication with similarly-enabledsystems and devices.

Any one or more of the communication subsystem 211, the NFC subsystem265 and the short-range wireless communications subsystem 262 serves asa “communication subsystem” which is configured to provide an indicatorof the number of incoming messages being received by the electronicdevice 201. The incoming messages may be emails, messages received via asocial networking website, SMS (short message service) messages, ortelephone calls, for example.

The electronic device 201 is, in some exemplary embodiments, a mobilecommunication device which may provide two principal modes ofcommunication: a data communication mode and a voice communication mode.In the data communication mode, a received data signal such as a textmessage, an email message, or Web page download will be processed by thecommunication subsystem 211 and input to the processor 240 for furtherprocessing. For example, a downloaded Web page may be further processedby a browser application or an email message may be processed by anemail messaging application and output to the display 204. A user of theelectronic device 201 can compose data items, such as email messages;for example, using the input devices in conjunction with the display204. These composed items may be transmitted through the communicationsubsystem 211 over the wireless network 101.

In the voice communication mode, the electronic device 201 providestelephony functions and operates as a typical cellular phone. Theoverall operation is similar, except that the received signals would beoutput to the speaker 256 and signals for transmission would begenerated by a transducer such as the microphone 258. The telephonyfunctions are provided by a combination of software/firmware (i.e., avoice communication module) and hardware (i.e., the microphone 258, thespeaker 256 and input interfaces 206). Alternative voice or audio I/Osubsystems, such as a voice message recording subsystem, may also beimplemented on the electronic device 201. Although voice or audio signaloutput is typically accomplished primarily through the speaker 256, thedisplay screen 204 may also be used to provide an indication of theidentity of a calling party, duration of a voice call, or other voicecall related information.

The processor 240 operates under stored program control and executessoftware modules 221 stored in memory such as persistent memory; forexample, in the flash memory 244. As illustrated in FIG. 1, the softwaremodules 221 include operating system software 223 and other softwareapplications 225 such as a media player module 260. In the exemplaryembodiment of FIG. 1, the media player module 260 is implemented as astand-alone application 225. However, in other exemplary embodiments,the presentation module 260 could be implemented as part of theoperating system 223 or other applications 225.

As discussed above, electronic devices 201 which are configured toperform operations in relation to a communications log may take avariety of forms. In at least some exemplary embodiments, one or more ofthe electronic devices which are configured to perform operations inrelation to the presentation module 260 are a smart phone or a tabletcomputer.

Referring now to FIG. 2, a front view of an exemplary electronic device201 which in one example may be a smartphone 100 is illustrated. Thesmartphone 100 is a mobile phone which offers more advanced computingcapability than a basic non-smartphone cellular phone. For example, thesmartphone 100 may have the ability to run third party applicationswhich are stored on the smartphone.

The smartphone 100 includes all of the components discussed above withreference to FIG. 1, or a subset of those components. The smartphone 100includes a housing 104 which houses at least some of the componentsdiscussed above with reference to FIG. 1.

In the exemplary embodiment, the smartphone includes a display 204,which may be a touchscreen which acts as an input interface 206. Thedisplay 204 is disposed within the smartphone 100 so that it is viewableat a front side 102 of the smartphone 100. That is, a viewable side ofthe display 204 is disposed on the front side 102 of the smartphone. Inthe exemplary embodiment illustrated, the display 204 is framed by thehousing 104.

The example smartphone 100 also includes other input interfaces 206 suchas one or more buttons, keys or navigational input mechanisms. In theexample illustrated, at least some of these additional input interfaces206 are disposed for actuation at a front side 102 of the smartphone.

The example smartphone also includes a speaker 256. In the exemplaryembodiment illustrated, the smartphone includes a single speaker 256which is disposed vertically above the display 204 when the smartphone100 is held in a portrait orientation where its height is longer thanits width. The speaker 256 may be disposed on the front face of thesmartphone 100.

While the example smartphone 100 of FIG. 2 includes a single speaker256, in other exemplary embodiments, the smartphone 100 may include agreater number of speakers 256. For example, in at least some exemplaryembodiments, the smartphone 100 may include a second speaker 256 whichis disposed vertically below the display 204 when the smartphone is heldin a portrait orientation where its height is longer than its width(i.e. the orientation illustrated in FIG. 2).

The example smartphone 100 also includes a microphone 258. In theexample illustrated, the microphone 258 is vertically disposed below thedisplay 204 when the smartphone is held in the portrait orientation. Themicrophone 258 and at least one speaker 256 may be arranged so that themicrophone is in close proximity to a user's mouth and the speaker 256is in close proximity to a user's ear when the user holds the phone totheir face to converse on the smartphone.

The example smartphone 100 also includes a front facing camera 253 whichmay be located vertically above the display 204 when the smartphone 100is held in a portrait orientation where its height is longer than itswidth. The front facing camera 253 is located so that it may captureimages of objects which are located in front of or surrounding the frontside of the smartphone 100.

The example smartphone 100 also includes an electromagnetic radiationsource 257. The electromagnetic radiation source 257 is disposed on thefront side 102 of the smartphone 100. In this orientation,electromagnetic radiation which is produced by the electromagneticradiation source 257 may be projected onto objects which are located infront of or surrounding the front side of the smartphone 100. Suchelectromagnetic radiation (or the projection of electromagneticradiation onto objects) may be captured on images detected by the camera253.

Referring now to FIG. 3, a front view of an example electronic device201, which in one example may be a tablet computer 300, is illustrated.The tablet computer 300 may include the components discussed above withreference to FIG. 1 or a subset of those components. The tablet computer300 includes a housing 304 which houses at least some of the componentsdiscussed above with reference to FIG. 1.

The tablet computer 300 includes a display 204, which may be atouchscreen which acts as an input interface 206. The display 204 isdisposed within the tablet computer 300 so that it is viewable at afront side 302 of the tablet computer 300. That is, a viewable side ofthe display 204 is disposed on the front side 302 of the tablet computer300. In the exemplary embodiment illustrated, the display 204 is framedby the housing 304.

A frame 312 surrounds the display 204. The frame 312 is portion of thehousing 304 which provides a border around the display 204. In at leastsome exemplary embodiments, the frame 312 is an active frame 312. Thatis, the frame has a touch sensitive overlay which allows the electronicdevice 201 to detect a touch applied to the frame thus allowing theframe 312 to act as an input interface 206 (FIG. 1).

The exemplary tablet computer 300 includes a plurality of speakers 256.In the exemplary embodiment illustrated, the tablet includes twospeakers 256. The two speakers 256 are disposed on opposing sides of thedisplay 204. More particularly, when the tablet computer 300 is held ina landscape orientation (such as the orientation illustrated in FIG. 3)where its width is longer than its height, one of the two speakers isdisposed on a right side 306 of the display 204 and one of the speakersis disposed on the left side 308 of the display 204.

Both speakers 256 are disposed on the front side 302 of the tabletcomputer 300.

The exemplary tablet computer 300 also includes a microphone 258. In theexample illustrated, the microphone 258 is vertically disposed below thedisplay 204 when the tablet computer is held in the landscapeorientation illustrated in FIG. 3. The microphone 258 may be located inother locations in other exemplary embodiments.

The exemplary tablet computer 300 also includes a front facing camera253 which may be located vertically above the display 204 when thetablet computer 300 is held in a landscape orientation (i.e. theorientation of FIG. 3). The front facing camera 253 is located so thatit may capture images of objects which are located in front of orsurrounding the front side of the tablet computer 300.

The example tablet computer 300 also includes an electromagneticradiation source 257. The electromagnetic radiation source 257 isdisposed on the front side 304 of the tablet computer 300. In thisorientation, electromagnetic radiation which is produced by theelectromagnetic radiation source 257 may be projected onto objects whichare located in front of or surrounding the front side 302 of the tabletcomputer 300. Such electromagnetic radiation (or the projection ofelectromagnetic radiation onto objects) may be captured on imagesdetected by the camera 253.

The tablet computer 300 may have the ability to run third partyapplications which are stored on the tablet computer.

The electronic device 201, which may be tablet computer 300, is usableby an end-user to send and receive communications using electroniccommunication services supported by a service provider.

The end-user of an electronic device 201 may send and receivecommunications with different entities using different electroniccommunication services. Those services may or may not be accessibleusing one or more particular electronic devices. For example, acommunication source of an end-user's text messages sent and received byan end-user using a particular electronic device 201 having a particularmemory module 230, such as a USIM, may be accessible using that device201, but those text messages may not be accessible using another devicehaving a different memory module. Other electronic communicationsources, such as a web-based email account, may be accessible via aweb-site using a browser on any internet-enabled electronic device.

FIG. 4 shows a system of networked apparatus by which electroniccommunications can be sent and received using multiple electronicdevices 201 a, 201 b, 201 c. Referring to FIG. 4, electronic devices 201a, 201 b and 201 c are connected to wireless network 101 to performvoice and data communications, and to transmit data to an externaldisplay device 290 residing on the wireless network. Wireless network101 is also connected to the Internet 400. Electronic device 201 a maybe a tablet computer similar to tablet computer 300 described in FIG. 2above. Electronic devices 201 b and 201 c may be smartphones. Electronicdevice 201 d is a computing device such as a notebook, laptop ordesktop, which is connected by a wired broadband connection to LocalArea Network 420, and which is also connected to the Internet 400.Electronic devices 201 a, b, c, d may access the Internet 400 to performdata communications therewith.

Servers 410 a, 410 b, 410 c and 410 d are also connected to the Internet400 and one or more of them may individually or together supportelectronic communications services available to end-users of electronicdevices 201 a, 201 b, 201 c and 201 d, enabling them to send and receiveelectronic communications. Servers 410 a, 410 b, 410 c and 410 d may beweb servers or communications servers, such as email servers.

Other servers and services may of course be provided allowing users ofelectronic devices 201 a, 201 b, 201 c and 201 d to send and receiveelectronic communications by, for example, Voice over IP phone calls,video IP calls, video chat, group video chat, blogs, file transfers,instant messaging, and feeds.

Wireless network 101 may also support electronic communications withoutusing Internet 400. For example, a user of smart phone 201 b may usewireless network 101 to make telephony calls, video calls, send textmessages, send multimedia messages, and send instant messages to smartphone 201 c, and to display application data on a display screen of theexternal display device 290, or control the display of application data.

The example shown in FIG. 4 is intended to be non-limiting andadditional network infrastructure may of course be provided, such as aPublic Switched Telephone Network (not shown), which may be used, forexample, to make telephony calls using smartphone 201 b to a wired phone(not shown).

To explain exemplary modes of operation, reference will now be made toFIGS. 5 to 8.

FIG. 5 depicts a flow chart depicting a method 500 performed by theprocessor 240 for generating the display data which is output on thedisplay screen 204. At block 504, the input interface 206 detects orobtains an input. The input may comprise any suitable input for issuinga command to the processor 240 via the input interface 206. For example,the input interface 206 may comprise a microphone and the input comprisea voice input; the input interface 206 may be an orientation sensor 251and the input comprise a location of the device 201 relative to an NFCtransceiver; the input interface 206 may be an orientation sensor 251comprising an accelerometer and the input comprise movement of thedevice 201 by shaking.

The input interface 206 may also comprise the touchscreen, in which casethe electronic device 201 may be referred to as a ‘multi-touch device’.The input detected by the touchscreen interface may comprise anysuitable user touch-based input. For example, the input may comprise agesture input such as a tap, a multi-tap, a long press, a swipe orscroll or slide, a pan, a flick, a multi-swipe, a multi-finger tap, amulti-finger scroll or swipe, a pinch, a two-hand pinch, a spread, atwo-hand spread, a rotation, a two-hand rotation, a slide and rotation,a multi-direction slide, a multi-finger slide and rotation, amulti-finger slide, etc. It will be appreciated that the gesture inputmay comprise a sequence of input elements or stages performed within aspecified or predetermined time frame, for example, a three-tap gesturein which each tap comprises an element (or a sub-input, a phase or astage) of the input and the three taps are performed within a time framethat enables the processor 240 to detect the taps as elements of asingle input. Additionally or alternatively, an input may compriseremoving a point of contact, e.g. a finger or stylus, from thetouchscreen interface.

Although many examples described herein refer to a gesture detected by atouch-sensitive display, other methods of gesture detection may beutilized. For example, a gesture may be a generalized trajectorydescription characterized as a sequence of 3D points in time, and assuch many different sensors may be utilized to detect such a gesture.The gesture may be performed by moving a portable electronic device ormoving one or more body parts, such as fingers or thumbs as a 3D spatialgesture. For example, sensors, such as an accelerometer/gyroscope, orproximity sensors, or time-of-flight cameras may detect such gestures.Gesture recognition and detection techniques of this type are known.

An accelerometer or gyroscope may be utilized to detect 3D spatialgestures. A sequence of acceleration values may be detected in thedifferent spatial dimensions as a function of time and constitutetrajectory information that can be recognized as a gesture. For example,a quick flick or tilt of the portable electronic device are examples ofdetectable gestures. A 3D spatial gesture includes a continuousmovement, a sequence of movements, and a series of continuous movementsor sequences of movements. Proximity sensors, optical sensors, and/orcameras may be utilized to detect 3D spatial gestures comprising motionof objects spaced from the device.

A gesture input is different to input of a command by manipulation of acontrol component presented on the screen because a gesture input can beperformed at any location within the display screen (or a large area ofthe display screen) in contrast to a single contact point for a userfinger or input stylus on a corresponding control element. In order toinput a command using a control component, the user must contact thescreen at a specific location corresponding to that component. Forexample, in order to change an output volume using a volume control, theuser must select the volume control by touching the location at whichthe volume control is displayed and moving the displayed control elementby a desired amount through movement of the user's finger across thescreen. Such user input must therefore be precisely controlled in orderto use control elements to input commands. Gesture-based inputs, on theother hand, do not require the same precise control as they are not tiedto a specific location on the screen. Instead, a user wishing to, e.g.,scroll through a list of media content can do so by performing a swipegesture at any location within a media-player display.

At block 506, the processor 240 generates or updates the display datacomprising a display object for display by the display device 204. Thedisplay object is representative of an action that will be performed bythe processor 240 if the input is continued or completed, i.e. theaction that will subsequently be performed by the processor 240 only ifthe input is determined to be completed or continued beyond a thresholdextent or sufficiently for the processor to determine that the inputcomprises a command to perform the action. Up to this point, theprocessor 240 does not perform the action and the input is thereforeundoable up until its completion and the action is not performed. Thisis discussed in further detail with respect to FIG. 6 below.

At block 508, the processor 240 outputs the generated or updated displaydata comprising the updated display object to the output interface 205.

At block 510, the processor 240 determines whether the input detectedvia the interface 206 is a first input as shown in FIG. 6A(i)-(iii), ora second input as shown in FIGS. 6B (i) to (iii).

At block 512 the processor 240 performs the action only on continuationor completion of the input or on determination that the input comprisesthe first input. If the input is not continued, the processor 240determines that the input comprises the second input and does notperform the action. Instead, if the input comprises the second input,processing resumes at block 504.

FIGS. 6A(i)-(iv) and 6B(i)-(iv) depict the display 204 displaying aninterface 601 of a media player which is generated from the display dataoutput by the processor 240. A user can control or modify the mediaoutput by manipulating the control components 603. This manipulationrequires the user to touch the screen at the location at which eachcontrol component is displayed. Additionally or alternatively, the usercan control or modify the output of the media using gesture basedinputs. As discussed in relation to FIG. 5, a gesture input may beperformed at any location on the media player interface 601.

FIGS. 6A(i)-(iv) and 6B(i)-(iv) depict example sequence of inputs, thecontinuation (or completion) of which results in the processor 240causing a media player to output (or play) a next track in a playlist.In particular, FIG. 6A(i) shows the display 204 for a media playerapplication running, or outputting a current track on the electronicdevice 201 through the speaker 256, whilst an input is initiated bytouching or making contact with the touchscreen interface 206 (e.g. witha finger or touchscreen stylus).

In FIG. 6A(ii), the input is continued by swiping (or moving or sliding)the point of contact in a horizontal motion across the touchscreeninterface 206. It will be appreciated that continuation of the input mayequally comprise moving the contact in a vertical or diagonal motionacross the touchscreen (or a combination of the three). Additionally oralternatively, continuation of the input may comprise maintaining thecontact with the touchscreen interface 206 without movement of the pointof contact, or completing any of the gesture inputs discussed above withrespect to block 502. Completing an input, e.g. a gesture input, meansperforming the input to an extent required to cause the processor todetermine that an action (e.g. start playing the next track) is to beperformed in response to the input.

The display object 602 is representative of the action that will beperformed if the input is continued beyond the common initial phase toprovide the first input. In the example of FIG. 6, the display object602 comprises a well-known symbol representing the action of skipping(or jumping) to the subsequent track listed by the media player andoutputting that track. In this case, the action that will be performedon continuation of the action will be the output of the next track inthe playlist and this action is represented by the “next track” displayobject 602.

In addition to representing the action that the processor 240 willsubsequently perform on continuation of the input, the display object602 may also represent a current phase, stage, or degree of completion,of the input through variation of a parameter or characteristic of thedisplay object 602. For example, the display object 602 shown in FIGS.6A(ii) and 6B(ii) is part-filled (or part coloured-in) to represent thatthe contact has been moved part of the distance required to provide thefirst input (i.e. part of the distance required to cause the processor240 to perform the action).

Further examples of suitable display objects include arrows, other knownmedia player control symbols, text, egg-timer symbols, images of mediacontent or software applications, or a number of these elements groupedtogether as a display object. Each display object 602 has one or morevisual parameters associated with it which can be varied to show degreeof completion of the input and which comprise one or more of brightness,colour, contrast, opacity, frequency, amplitude, speed, or the number orthickness of a plurality of lines (e.g. hatching).

As shown in FIG. 6A(iii)(a), the input is completed by moving thecontact to a sufficient extent to cause the processor 240 to perform theaction thereby resulting in the media player outputting the subsequenttrack in a playlist. In this case, the display object 602 is filled-in,thereby indicating that the input has been completed. FIG. 6A(iv)depicts the output display 601 of the media player after the actioncorresponding to the input has been completed, i.e. the media playerdisplay depicting the track which is now being played.

FIGS. 6B(i)-(iv) show the display 204 depicting a second input in whichthe input is not continued to a sufficient extent to result in theprocessor 240 performing the action. It can be seen that the inputstages depicted in FIGS. 6B(i) and 6B(ii) are respectively the same asthose depicted in FIGS. 6A(i) and 6A(ii). Hence, these input stagescorrespond to an initial input (or initial input phase or stage) that iscommon to both the first and second input.

During this common initial input phase, the processor 240 is able todetermine the potential action that it will perform in response to theinput, i.e. the action that will subsequently be performed by theprocessor 240 if the input is continued to provide a first input asdepicted in FIG. 6A (i.e. if the common initial input phase is followedby the phase depicted in FIG. 6A(iii)(a)). However, during this commoninitial input, the processor 240 cannot yet determine whether or notthis action will be performed as the common initial input may instead befollowed by the phase depicted in FIG. 6B(iii).

In the example depicted in FIG. 6B(iii), the contact with thetouchscreen interface 206 has not moved a sufficient distance forcontinuation of the input beyond the common initial phase as depicted inFIG. 6A(iv). Instead, the contact is moved back toward the location atwhich the contact was initially made or simply released, thereby‘undoing’ or abandoning the input. In this case, the media playerinterface 601 returns to the original screen at FIG. 6B(iv) and themedia player continues to play the current track.

Whilst the displays of FIGS. 6A(i)-(iv) and 6B(i)-(iv) relate to aninput comprising a swipe across a touchscreen interface 206, analogoussequences arise for other types of input. For example, for a voiceinput, the common initial phase may comprise inputting a voice signal ofa given intensity, with a first input type being provided if the voiceinput intensity continues above a threshold intensity or for a durationlonger than a threshold duration, whilst a second input is provided ifthe voice input intensity does not surpass the intensity or durationthreshold in which case, the processor 240 does not perform the action.

Similarly, in the example of an input comprising shaking the electronicdevice 201, if the shaking intensity continues beyond a thresholdintensity or a threshold duration, the input will be the first input andthe processor 240 will perform the corresponding action. Alternatively,if the shaking intensity does not continue beyond the thresholdintensity the second input is provided, in which case the processor 240does not perform the corresponding action.

As discussed, the display object 602 is progressively filled further (orcoloured in) as the distance moved by the contact increases. In thisway, the further movement or input required in order to cause theprocessor 240 to perform the relevant action is indicated (orrepresented or symbolised) by the display object 602. A user of thedevice 201 is therefore guided by the display object with respect to theinput required in order to cause a desired output. Additionally, theuser is guided by the display object as to whether or not it is possibleto abandon the input without causing performance of the subsequentaction.

FIG. 7 is a flow chart depicting a method 700 for generating displaydata. Block 704 of method 700 corresponds directly to block 504 ofmethod 500.

At block 706, the processor 240 generates or updates data comprising asecond type of display object 604 for display by the display device 204,wherein the display object 604 is representative of content that willsubsequently be output on continuation or completion of the user input.In the examples of FIGS. 6(i)-(iv), the display object 604 is a bannerdisplaying a title of a song that will be played if the user completes ahorizontal swipe gesture. Further examples of display objects includethumbnail images or any other representation of an output on the displayscreen 204 or from other outputs of the device 201 that will occur inresponse to completion of the input.

At block 708, the processor 240 outputs the generated or updated data onthe display device 204. In this case, the processor 240 causes thedisplay object 604 to appear on the display device over time as the userinput is being detected by the input interface (or during performance ofthe user input). Furthermore, the processor 240 causes the displayobject 604 to appear on the display device 204 at a different rate tothe rate at which the user input is detected. For example, the processor240 may cause the display object 604 to appear on the display device ata rate faster (or slower) than the rate at which the user input isdetected via the interface. A particular example is when completion ofthe user input results in the processor 240 causing a media player toplay a next track, in which case the display object 604 shown in thefigures comprises a banner display of the title of the next track andthe banner display appears on the display screen 204 at a faster ratethan a rate of completion of the user input.

In the example of FIGS. 6A(i)-(iv), the display object 604 comprises thetitle of the song that will be played if the user completes the input.The display object 604 appears during the common initial input and isdecipherable before completion of the input. Accordingly, the user isinformed of the consequence of completing the input in sufficient timebefore completion of the input to allow the user to abandon (or undo)the input if desired. In this way, the display object provides a previewof a future operational state of the device 201 that will arise if theinput is completed.

FIG. 8 is a flow chart depicting a method 800 for modifying an output ofmedia content. At block 802 a media player application outputs mediacontent through the output interface 205. For example, the media playerapplication being executed by the processor 240 may play (or output) atrack or a video stored in the memory 244 through the speaker 256, thedisplay device 204 or both the speaker 256 and the display device.Alternatively, the media player application may play a track or a videostored at a remote location accessed across the network 101 through thespeaker 256, the display device 204 or both the speaker 256 and thedisplay device 204.

At block 804, the processor 240 detects a first input comprising a swipegesture across the touchscreen interface 206. In particular, the swipegesture may be across the media player interface 601. The swipe may bein a vertical, horizontal or diagonal direction across the touchscreeninterface 206 or a gesture input comprising a multi-directional swipegesture.

At block 806, the processor 240 modifies the current output of the mediacontent in response to the first input detected by the touchscreeninterface 206. For example, the processor 240 may pause the output ofthe media content, increase or decrease the output volume of the mediaplayer, cause the media player to output the next or the previous trackinstead of a current track, or perform any other suitable modificationof the media content output. In this manner, the main functions of amedia player application can be easily and efficiently controlled by auser even in situations where the user is unable to view the electronicdevice 201 or precisely control the input.

At block 808, the processor 240 detects a second user input comprising aswipe gesture in a direction (or directions) opposite to the first swipegesture input. For example, if the first swipe gesture input is avertical swipe across the touchscreen interface in an upward direction(FIG. 6A(iii)(b)), the second swipe gesture input comprises a verticalswipe across the touchscreen interface in a downward direction (FIG.6A(iii)(c)).

At block 810, the processor 240 responds to the second swipe gesture byreversing the performance of the modification (or ‘undoing’ themodification of block 806). For example, if the processor 240 pausesoutput of a song in response to a downward vertical swipe gesture, theprocessor 240 then re-commences output of the song in response to anupward vertical swipe gesture. Similarly, if the processor 240 increasesthe output volume in response an upward vertical swipe gesture, theprocessor 240 then decreases the output volume (or returns to theoriginal output volume) in response to a downward vertical swipegesture.

It will be appreciated that, as discussed in relation to FIGS. 5,6A(i)-(iv) and 6B(i)-(iv), at block 806, 808, or both, the processor 240may only modify the media output (i.e. perform the action correspondingto the input) if the input is determined to be a first type of input asdiscussed in relation to FIGS. 6 A(i)-(iv) and 6B(i)-(iv).

The invention claimed is:
 1. A method for generating display data, themethod comprising: detecting user input via an input interface, the userinput comprising a portion of a first input; and operating a processorin communication with the input interface to: in response to detectinguser input, generate display data comprising a display object fordisplay by a display device, wherein the display object symbolizescontent that will subsequently be output by the processor completion ofthe user input; and output the display data on the display device whilsta common initial input of the first input is being detected in such away that the display object is caused to appear on the display device asthe common initial input is being detected, wherein the rate at whichthe display object appears is different to the rate of detection of thecommon initial input, wherein the first input comprises a firstadditional input which is detectable by the processor after the commoninitial input, wherein the display object is indicative of the firstadditional input which must be detected by the processor for it todetermine that the user input comprises the first input.
 2. The methodof claim 1, wherein the first input comprises a first additional inputwhich is detectable by the processor after the common initial input. 3.The method of claim 2, wherein the display object is representative ofthe first additional input which must be detected by the processor forit to determine that the user input comprises the first input.
 4. Themethod of claim 3, wherein the user input comprises: a second input, inresponse to which the processor does not perform the action, the secondinput also comprising the common initial input.
 5. The method of claim4, wherein the second input comprises a second additional input which isdetectable by the processor after the common initial input, wherein thefirst additional input and the second additional input are different. 6.The method of claim 1, further comprising operating the processor to:determine whether completion of the first input has occurred; andperform the action only if completion of the first input is detected. 7.The method of claim 1, wherein the display data is generated in such away that the display object is caused to appear on the display device asthe common initial input is being detected, wherein the rate at whichthe display object appears is different to the rate of detection of thecommon initial input.
 8. The method of claim 1, wherein the displayobject is representative of an extent of completion of the commoninitial input.
 9. The method of claim 8, wherein the display object isrepresentative of an extent of completion of the first input.
 10. Themethod of claim 1, wherein the action corresponds to a selection ofmedia content and wherein the processor outputs the media content. 11.The method of claim 1, wherein the user interface is a touchscreeninterface, the user input comprises a swipe gesture across thetouchscreen interface, and the action comprises modifying a currentoutput of media content.
 12. The method of claim 11, wherein modifyingthe current output of the media content comprises pausing output of themedia content.
 13. A non-transitory computer-readable medium comprisingexecutable instructions which, when executed, cause the processor to:detect user input via an input interface, the user input comprising aportion of a first input; generate display data comprising a displayobject for display by a display device, wherein the display object isrepresentative of content that will subsequently be output by theprocessor on completion of the user input; and in response to detectinguser input, output the display data on the display device whilst acommon initial input of the first input is being detected in such a waythat the display object is caused to appear on the display device as thecommon initial input is being detected, wherein the rate at which thedisplay object appears is different to the rate of detection of thecommon initial input, wherein the first input comprises a firstadditional input which is detectable by the processor after the commoninitial input, wherein the display object is indicative of the firstadditional input which must be detected by the processor for it todetermine that the user input comprises the first input.
 14. Thecomputer-readable medium of claim 13, wherein the first input comprisesa first additional input which is detectable by the processor after thecommon initial input.
 15. The computer-readable medium of claim 14,wherein the display object is representative of the first additionalinput which must be detected by the processor for it to determine thatthe user input comprises the first input.
 16. The computer-readablemedium of claim 15, wherein the user input comprises: a second input, inresponse to which the processor does not perform the action, the secondinput also comprising the common initial input.
 17. Thecomputer-readable medium of claim 16, wherein the second input comprisesa second additional input which is detectable by the processor after thecommon initial input, wherein the first additional input and the secondadditional input are different.
 18. The computer-readable medium ofclaim 13, the instructions further cause the processor to: determinewhether completion of the first input has occurred; and perform theaction only if completion of the first input is detected.
 19. Thecomputer-readable medium of claim 13, wherein the display data isgenerated in such a way that the display object is caused to appear onthe display device as the common initial input is being detected,wherein the rate at which the display object appears is different to therate of detection of the common initial input.
 20. The computer-readablemedium of claim 13, wherein the display object is representative of anextent of completion of the common initial input.
 21. Thecomputer-readable medium of claim 20, wherein the display object isrepresentative of an extent of completion of the first input.
 22. Thecomputer-readable medium of claim 13, wherein the action corresponds toa selection of media content and wherein the processor outputs the mediacontent.
 23. The computer-readable medium of claim 13, wherein the userinterface is a touchscreen interface, the user input comprises a swipegesture across the touchscreen interface, and the action comprisesmodifying a current output of media content.
 24. The computer-readablemedium of claim 23, wherein modifying the current output of the mediacontent comprises pausing output of the media content.
 25. A device forgenerating display data, the device comprising: an input interface fordetecting user input, the user input comprising a portion of a firstinput; and a processor in communication with the input interface, theprocessor being configured to: in response to detecting user input,generate display data comprising a display object for display by adisplay device, wherein the display object symbolizes content that willsubsequently be output by the processor on completion of the firstinput; and output the display data on the display device whilst a commoninitial input of the first input is being detected in such a way thatthe display object is caused to appear on the display device as thecommon initial input is being detected, wherein the rate at which thedisplay object appears is different to the rate of detection of thecommon initial input, wherein the first input comprises a firstadditional input which is detectable by the processor after the commoninitial input, wherein the display object is indicative of the firstadditional input which must be detected by the processor for it todetermine that the user input comprises the first input.
 26. The deviceof claim 25, wherein the first input comprises a first additional inputwhich is detectable by the processor after the common initial input. 27.The device of claim 26, wherein the display object is representative ofthe first additional input which must be detected by the processor forit to determine that the user input comprises the first input.
 28. Thedevice of claim 27, wherein the user input comprises: a second input, inresponse to which the processor does not perform the action, the secondinput also comprising the common initial input.
 29. The device of claim28, wherein the second input comprises a second additional input whichis detectable by the processor after the common initial input, whereinthe first additional input and the second additional input aredifferent.
 30. The device of claim 25, the processor being furtherconfigured to: determine whether completion of the first input hasoccurred; and perform the action only if completion of the first inputis detected.
 31. The device of claim 25, wherein the display data isgenerated in such a way that the display object is caused to appear onthe display device as the common initial input is being detected,wherein the rate at which the display object appears is different to therate of detection of the common initial input.
 32. The device of claim25, wherein the display object is representative of an extent ofcompletion of the common initial input.
 33. The device of claim 32,wherein the display object is representative of an extent of completionof the first input.
 34. The device of claim 25, wherein the actioncorresponds to a selection of media content and wherein the processoroutputs the media content.
 35. The device of claim 25, wherein the userinterface is a touchscreen interface, the user input comprises a swipegesture across the touchscreen interface, and the action comprisesmodifying a current output of media content.
 36. The device of claim 35,wherein modifying the current output of the media content comprisespausing output of the media content.